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Abstract. We study conjugacy classes of solutions to systems of 
equations and inequations over torsion-free hyperbolic groups, and 
describe an algorithm to recognize whether or not there are finitely 
many conjugacy classes of solutions to such a system. The class of 
immutable subgroups of hyperbolic groups is introduced, which is 
fundamental to the study of equations in this context. We apply 
our results to enumerate the immutable subgroups of a torsion-free 
hyperbolic group. 



1. Introduction 

This paper is concerned with decision problems relating to systems of 
equations and inequations over torsion-free hyperbolic groups, a sub- 
ject with a long history. Makanin |T7j proved that it is possible to 
decide whether a system of equations over a free group has a solution, 
and in [18] he extended this result to systems of equations and inequa- 
tions. Razborov pil [22] described an algorithm whose output gives a 
parametrization of the entire set of solutions to a system of equations 
over a free group. His description was further refined by Kharlampov- 
ich and Miasnikov [15]. 

Over torsion-free hyperbolic groups. Rips and Sela [21] proved that 
it is possible to decide if a system of equations has a solution. The cor- 
responding result for systems of equations and inequations was proved 
independently by Sela [2B] and Dahmani [5]. 

The study of equations over groups has recently received a lot of 
attention due to the solutions to Tarski's problem by Sela [21] and also 
by Kharlampovich and Miasnikov [16]. Our approach is inspired by 
Sela's results, and we use some of his structure theory. 
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Theorem A. There is an algorithm that takes as input a finite pre- 
sentation for a torsion-free hyperbolic group T and a finite system of 
equations and inequations with coefficients in T and determines whether 
or not the system has only finitely many solutions in T. 

If there are finitely many solutions, the algorithm provides a list of 
all the solutions. 

In the case where F is a free group and the system has only equations, 
this theorem is immediate from Razborov's description of the set of 
solutions. Also, if F is free and there are inequations, it is not difficult 
to deduce Theorem |A] from Razborov's results. However, for general 
torsion- free hyperbolic F, more work is required. 

When the system of equations and inequations has no coefficients, 
F naturally acts by conjugation on the set of solutions. Therefore, 
if F is non-elementary and there is at least one solution then there 
are infinitely many. Thus, in the case of coefficient-free equations and 
inequations. Theorem [A] follows immediately from the above-mentioned 
result of Sela and Dahmani. 

It is therefore natural to consider the orbits of solutions under the 
action by conjugation. For example, in Sela's definition of limit groups, 
he takes a minimal solution in a conjugacy class in order to ensure that 
the limiting action on an M-tree has no global fixed point. Conjugacy 
classes of solutions are thus of fundamental concern for Sela's approach 
to the Tarski problem (although this is only the very beginning of the 
story). 

Our next result concerns conjugacy classes of solutions. 

Theorem B. There is an algorithm that takes as input a finite presen- 
tation for a torsion-free hyperbolic group F and a finite ( coefficient-free ) 
system of equations and inequations and determines whether or not the 
system has only finitely many conjugacy classes of solutions in F. 

If there are finitely many conjugacy classes of solutions, the algorithm 
provides a list containing exactly one solution in each conjugacy class. 

Remark 1.1. // F is free, when there is one solution (and no coeffi- 
cients) there are infinitely many conjugacy classes of solutions. How- 
ever, this may not be the case for arbitrary hyperbolic F. See Example 

Although we believe it to be of independent interest, one of our mo- 
tivations for proving Theorem[B]is its use in the study of F-limit groups 
(see Section [3]), where F remains a torsion- free hyperbolic group. Un- 
like the case of limit groups (when F is free), F-limit groups may not be 
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finitely presentable. In fact, every F-limit group is finitely presentable 
if and only if F is coherent. 

The basic building blocks of F-limit groups are free groups and 
finitely generated subgroups of F that admit only finitely many conju- 
gacy classes of embeddings into F. We call such subgroups immutable. 
Any study of F-limit groups, or even the subgroups of F, must take 
into account immutable subgroups. They are one of the key technical 
differences between ordinary limit groups over free groups and F-limit 
groups (see Remark [7.31) . 

The expert reader may be interested to learn that, by the results 
of [2B], there is an analogue over torsion-free hyperbolic groups of the 
analysis lattice that appears in [26]. Immutable subgroups appear at 
the lowest level of the analysis lattice. This analogy will be made 
explicit in forthcoming work [T3] . 

We will see in Section [7] that there is a natural relationship between 
immutable subgroups and systems of equations and inequations with 
finitely many conjugacy classes of solutions (see Example 17.61) . We 
exploit Theorem [B] to enumerate the immutable subgroups of F. 

Theorem C. Let T be a torsion-free hyperbolic group. The set of 
immutable subgroups of F is recursively enumerable, in the following 
sense: there exists a Turing machine that lists all finite subsets of F 
that generate immutable subgroups. 

This result is perhaps surprising because the finitely generated sub- 
groups of (torsion-free) hyperbolic groups are notoriously badly be- 
haved when it comes to decision problems. However, one of the themes 
of our work is that when it comes to equations and inequations, most 
of these difficulties can be surmounted. In [13], we will combine Theo- 
rem [C] with the techniques of [12] to recursively enumerate all F-limit 
groups. 

Remark 1.2. All of the algorithms we provide are uniform, in the 
sense that they can take as input a finite presentation for F as well 
as the equations and inequations. Thus, they work for all torsion-free 
hyperbolic groups in a uniform manner. 

An outline of this paper is as follows. In Section [2] we record the 
obvious rephrasing of solutions to equations and inequations over F in 
terms of homomorphisms to F. Section [3] contains some basic defini- 
tions and facts about F-limit groups. In Section H] we introduce the 
notion of T - approximations, which are a key tool to circumvent the 
fact that F-limit groups may not be finitely presentable. In Section [5] 
we present the halves of the algorithms required for Theorems |A] and [B] 
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which recognize when the appropriate sets are infinite, whereas in Sec- 
tion [H] we provide the algorithms which recognize when they are finite. 
Finally, in Section [7] we discuss immutable subgroups of T and prove 
Theorem [Cl We end with some questions about immutable subgroups. 



2. Equations and homomorphisms 

The class of (word-)hyperbolic groups is well known — for an intro- 
duction, see for instance [5l Part III]. Throughout this paper F will 
be a fixed non-elementary torsion-free hyperbolic group. (The case in 
which F is elementary is interesting, but classical.) Fix a finite gener- 
ating set A = {ai, . . . , Qk} for F. Let F{A) be the free group on A, and 
6: F{A) —>■ F the canonical epimorphism. We will blur the distinction 
between the elements of F{A) and as elements of F. 

Let X = {xi, . . . , Xn} be a finite set of variables, and F{X) the free 
group on X. 

A system of equations is a collection S C F{X) * F{A). Write 
S = {o'i{x,a)}i(zj. A solution to S is a collection {'jk}k=i ^ F so that 
for each i G / we have (Ti{'j,a) =r 1- In other words, the result of 
substituting 7^ for Xj in each cTj (and interpreting the as the fixed 
generators for F) yields the trivial element of F. 

A system of equations and inequations is a pair of subsets S, A C 
F{X) * F{A). Suppose that A = {\j{x,a)}j^j. A solution to S = 1, 
A 7^ 1 is a subset 7 C F so that for each i G / we have o"j(7, a) = 1 and 
for each j E J we have Aj(7,a) 7^ 1. 

The letters Oj (and a~^) appearing in elements of S and A are called 
coefficients. We say that S and A are missing coefficients if they are 
subsets of the canonical copy of F{X) in F{X) * F{A). In case S and 
A are missing coefficients there are analogous subsets (still denoted S 
and A) of F{X), which we consider to be a coefficient-free system of 
equations and inequations (also called a system without coefficients). 
Therefore, we make a distinction between systems of equations and in- 
equations which happen not to contain any coefficients, and those which 
are coefficient-free. This distinction is made because in the coefficient- 
free setting F acts by conjugation on the set of solutions, whereas it 
does not when there are coefficients. 

Following Razborov [21], it is natural to interpret solutions to sys- 
tems of equations and inequations as homomorphisms to F. If S is 
coefficient-free, define the group H-^ by the presentation 



(1) 



H^ = {X\a,{x) = l,ieI). 
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If E has coefficients, define the group Hj^ by the presentation 
(2) {X,A\ai{x,a) = lJeI). 

In this case, the coefficient subgroup of H^, is the subgroup generated 
by ^ C Hj:. 

When S has coefficients, the set of solutions to S is naturally in 
one-to-one correspondence with the set of homomorphisms: 

Homr(-ffE,r) = {h: Hy^^T \ h{ai) = Oj}. 

If S is coefficient-free the set of solutions is parameterized by the full 
set of homomorphisms from Hy. to F, denoted Hom(ifs, T)- 

The set of solutions to S = 1, A 7^ 1 is naturally in one-to-one 
correspondence with a smaller set of homomorphisms: 

IHomr(i/s,r; A) = {h: ^ T \ h{ai) = a,,h{\,) ^ 1}. 

(In the coefficient-free case, there is an obvious analogous definition for 
IHom(i7s,r;A).) 

Under this simple reformulation, if S and A are finite. Theorem 1X1 
asserts that there is an algorithm that decides if IHomr(ifs; T; A) is 
finite. 

If E and A are coefficient-free, we can post-compose an element of 
IHom(ifs, T; A) by an element of Aut(r), and we will get another el- 
ement of IHom(ifs, T; A). In particular, F acts on IHom(ifs, T; A) by 
conjugation. 

We denote the set IHom(^rs, T; A)/r by 0{Hj:,T;A). Theorem 
[B] asserts that there is an algorithm that recognizes whether or not 
0{Hy,T;A) is finite. 

3. T-LIMIT GROUPS 

One of our key tools is the theory of T-limit groups, as introduced 
and studied when F is torsion-free hyperbolic by Sela in [28]. One of 
the main difficulties in studying F-limit groups as opposed to ordinary 
limit groups (when F is free) is that if F is not coherent then F-limit 
groups will not all be finitely presented. 

Remark 3.1. The Rips construction [23] can he used to construct many 
torsion-free hyperbolic groups which have finitely generated subgroups 
that are not finitely presented. 

Recall the following two definitions, due to Bestvina and Feighn in 
the case of free groups. 
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Definition 3.2. [U Definition 1.5] Let G be a finitely generated group, 
and let {hn : G ^ T} be a sequence of homomorphisms. The stable 
kernel of {hn}, denoted Kerjhn), is the set of all elements g E G so 
that g G kerihn) for all but finitely many n. 

The sequence {hn} is stable if for all g E G, either g G Ker {hn) or, 
for all but finitely many n, g ^ ker{hn)- 

Definition 3.3. [D, Definition 1.5] A F-limit group is a group of the 
formL = Hj]/Ker{hn) where is a coefficient-free system of equations, 
Hy, is as in the previous section, and {hn} C Hom(ifs,r) is a stable 
sequence. 

A restricted F-limit group is a group of the form L = Hy./ Ker {hn) 
where E zs a system of equations with coefficients, and {hn} C Homr(-ffs, F) 
is a stable sequence. The image of the coefficient subgroup of Hy. in L 
is called the coefficient subgroup of L. 

It should be noted that restricted F-limit groups are, in particular, 
F-limit groups. Almost all of the theory of restricted F-limit groups is 
identical to that of F-limit groups. Often in this paper we will omit the 
adjective 'restricted'; this should not cause the reader any confusion. 

Remark 3.4. By taking a constant sequence of homomorphisms, we 
see that all finitely generated subgroups ofT are T-limit groups. 

Definition 3.5. A T-limit group is called strict if it can be represented 
as Hy, I Ker jhn) where {hn'- Hy F} are pairwise non- conjugate. 

A restricted T-limit group is strict if it can be represented as Hy/ Kerjhn) 
where {hn'- Hy — ^ F} are pairwise distinct. 

We refer the reader to [28] for the basic theory of F-limit groups 
where F is a torsion-free hyperbolic group. However, we do emphasize 
two features. Recall that if H and G are groups then we say that 
G is fully residually H if for every finite subset A C G there is a 
homomorphism hA : G ^ H which is injective on A. 

Proposition 3.6. [2HI Proposition 1.18] Let T be a non- elementary 
torsion-free hyperbolic group. A finitely generated group G is fully resid- 
ually T if and only if it is a T-limit group. 

The above property will be used several times in this paper without 
comment. 

A strict F-limit group L is naturally equipped with a faithful action 
on an M-tree. If L is a strict restricted F-limit group, the coefficient 
subgroup of L acts elliptically on this tree. In order to apply the 
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Rips Machine [251 E] ^^^^ deduce that L sphts (relative to the coeffi- 
cient subgroup), we need to know that the action has no global fixed 
point. This is the content of the following standard proposition. In the 
coefficient-free case, this is proved in [20], [2] or [6], for example. The 
case with coefficients is well-known to the experts, but as far as we are 
aware there is no proof in the literature. We take this opportunity to 
record a proof, which was communicated to the first author by Sela. 

Proposition 3.7. Any strict T -limit group L acts without a global fixed 
point on an M-tree. If L is restricted the action may be chosen so that 
the coefficient subgroup fixes a point. 

Proof ( Case with coefficients) . We start by outlining the standard con- 
struction of the M-tree as a pointed Gromov-Hausdorff limit; see [6] or 
[3], for instance, for details. Fix a word metric d on F. Let {hn} C 
Homr(i?s, F) be a stable sequence of pairwise distinct homomorphisms. 
For each n define the scaling factors 5„ and the basepoint = 1 e F. 
For each n we have an action of H^, on F, equipped with the rescaled 
word metric d/5n- A subsequence of this sequence of actions converges 
(in the pointed Gromov-Hausdorff topology) to an action of H^. on 
a Gromov- hyperbolic space T equipped with a basepoint *. Because 
the sequence {hn} is pairwise distinct, the scahng factors 5n tend to 
infinity, and it follows that T is an M-tree. The kernel of the action of 
i^E on T clearly contains Ker {hn)-, so the action of H^, descends to an 
action of L on T. 

For each element g of the coefficient subgroup of iJs, hn{g) = g for 
each n and so d{l, hn{g))/Sn tends to 0. It follows that g* = *, so the 
coefficent subgroups of H-^ and hence L act elliptically, as required. 

It remains to prove that the action of L on T has no global fixed 
point. This is the part of the proof that differs significantly from the 
coefficient-free case. The problem is that, because of the coefficient 
subgroup, we could not conjugate the homomorphisms /i„ to make 
centrally located. Instead, we argue as follows. 

The proof of [281 Lemma 1.3(vi)] applies to show that segment sta- 
bilizers of the action of L on T are abelian. The coefficient subgroup of 
L is clearly isomorphic to F so is non-abelian. Therefore, the basepoint 
* is the unique point fixed by the coefficient subgroup. On the other 
hand, by construction some generator Xj moves * distance 1, so there 
is no global fixed point. □ 

We are particularly interested in cychc splittings that give rise to 
infinitely many outer automorphisms. 
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Definition 3.8. A cyclic splitting is essential if the edge group is of 
infinite index in any vertex group. 

The point of Theorem l3.9l is that one can choose the sphtting assured 
by the Rips Machine to be essential. 

Theorem 3.9 (Sela, [2H])- Let T be a non- elementary torsion-free hy- 
perbolic group, and let L be a non-abelian, freely indecomposable, strict 
T-limit group. Then L admits an essential cyclic splitting. 

If, furthermore, L is a restricted T-limit group then the splitting may 
he chosen so that the coefficient subgroup is elliptic. 

Sela needs Theorem 13.91 in [28l Section 2] (and claims that it is true 
on page 8). However, he does not prove it in [28]. In [261 Theorem 3.2] 
it is proved when F is free. There are only a couple of extra subtleties 
when r is not free, and essentially the same proof works (in particular, 
we know that Sela has a proof of Theorem 13. 9p . However, we feel 
uncomfortable simply asserting that this strategy works so we include 
our own proof here. The proof we present is inspired by a remark 
towards the beginning of the proof of [28l Theorem 3.2], that Theorem 
13.91 is straightforward once one knows that all abelian subgroups of L 
are finitely generated. 

Proof of Theorem \3.9\ . Note that F is a toral relatively hyperbolic group. 
Therefore we may apply the results of [11] to L. The advantage of this 
approach is that Theorem 13.91 is false in this context (see [HI Remark 
5.1]). Therefore, the proof of [TTl Corollary 5.12] does not rely on the 
result we are currently trying to prove, so there is no risk of circularity. 
The content of [HI Corollary 5.12] is that abelian subgroups of L are 
finitely generated. 

Consider the abelian JSJ decomposition A of L and collapse all edges 
that give rise to non-essential cyclic splittings of L, yielding a graph 
of groups A' for L. As pointed out in the proof of [261 Theorem 3.2], 
the action on an M-tree that arises from Proposition 13.71 leads (via 
[281 Theorem 1.5]) to either an essential cyclic splitting or a non-trivial 
abelian splitting of L. Therefore, we may assume that A' is non-trivial. 

Suppose that A' contains only non-cyclic edge groups, and let V be 
a non-abelian vertex group of this decomposition. Then V contains a 
non-cyclic abelian subgroup, so cannot be a subgroup of T. Hence V is 
a strict F-limit group, and so admits a non-trivial abelian splitting 6 
in which all non-cyclic abelian subgroups are elliptic, by [281 Lemma 
1.7]. As noted above, G cannot be an inessential cyclic splitting. The 
decomposition 6 of can be used to refine A'. If 6 has a trivial 
edge group, then we obtain a contradiction to the fact that L is freely 



CONJUGACY CLASSES OF SOLUTIONS 



9 



indecomposable. Otherwise, V is obtained from a rigid vertex group 
of A by adjoining finitely many roots and each such root is elliptic 
in every abelian splitting of L. Therefore, B can be used to refine 
A, and we obtain an abelian splitting of L in which W is not elliptic, 
contradicting the canonical properties of A. 

In the case with coefficients, the proof is almost identical. The only 
modification is that one works with the restricted abelian JSJ decompo- 
sition, rather than the full abelian JSJ decomposition. The restricted 
decomposition is obtained by only considering those splittings in which 
the coefficient subgroup is elhptic. □ 

4. T-APPROXIMATIONS AND SPLITTINGS 

We have already noted that F-limit groups need not be finitely pre- 
sented. Implementing algorithms involving groups that are not finitely 
presented is obviously more difficult than when the groups are finitely 
presented. We will circumvent this difficulty by working with finitely 
presented approximations to our F-limit groups. 

Remark 4.1. Any homomorphism (p: G ^ H induces a map 

(f)* : Hom(i7, T) Hom(G, T) 

via 4'*{h) = ho (j). If (f) is an epimorphism then 0* is an injection. 

Definition 4.2. Suppose that G is a finitely generated group. A T- 
approximation to G is a finitely presented group G together with an 
epimorphism 77 : G ^ G so that rj* is a bijection. 

Often the map rj will be implicit, and we will simply refer to G as a 
F- approximation to G. 

We also need a version of F- approximations for equations with coef- 
ficients. 

Definition 4.3. Let S, Sq be systems of equations with coefficients, 
and H-£,H-£q the associated groups. // So C S then there is a natural 
epimorphism rj : Hj^^ — > Hj: which in turn induces an injection 

r/*: Homr(i/E,r)-^Homr(i/so,r). 

A F-approximation to H-^ is a pair (-f^Eo) ^7) where Sq is a finite system 
of equations and rj* is a bijection. 

Saying that r]* is a bijection is equivalent to saying that every ho- 
momorphism from G to F factors through rj. To prove the existence 
of approximations, we appeal to the following result from [28], which 
states that torsion-free hyperbolic groups are equationally Noetherian. 
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Theorem 4.4. [28l Theorem 1.22] Let T he a torsion-free hyperbolic 
group. Then every infinite system of equations in finitely many vari- 
ables over r is equivalent to a finite subsystem. 

Note that the above resuh is only proved in [28] for equations with 
no coefficients. However, the more general result may be proved with 
exactly the same proof using the restricted Makanin-Razborov diagram 
rather than the (ordinary) Makanin-Razborov diagram. 

Translating Theorem 14.41 into the language of homomorphisms en- 
sures that approximations will always exist. 

Theorem 4.5. Suppose that T is a torsion-free hyperbolic group. For 
any sequence of epimorphisms of groups 

Gi ^ G2 ^ Gs ^ . . . 

the corresponding sequence of homomorphism varieties 

Hom(Gi, r) D Hom(G2, T) D Hom(G'3, T) . . . 

eventually stabilizes. 

In particular, for any finitely generated group G there is a finitely 
presented group G along with an epimorphism rj: G ^ G so that the 
injection rj* : Hom(G', F) Hom(G, F) is bijective. 

If G has a cyclic splitting, we can choose a F- approximation G that 
admits a splitting of the same form. To do this, we give a recipe for 
building a F-approximation G for a group G, given a graph-of-groups 
decomposition A of G with cyclic edge groups, and F-approximations 
for the vertex groups of A. 

Lemma 4.6. Suppose G = A*c B is a splitting of G over a (possibly 
trivial) cyclic subgroup G . Let rjA '■ A ^ A and tjb '■ B B be T- 
approximations and let Ca ^ A and Cb ^ B be (possibly trivial) cyclic 
subgroups with the property that ?7^(C'a) = Vb{Cb) = G . Then 

G = A*^ A B 

is a r - approximation to G. 

Proof. We can characterize Hom(G, F) as 

Hom(G, F) = {{a, (3) G Hom(A, F) x Hom(5, F) | a\c = /9|c}- 

We can characterize Hom(G, F) similarly, and the result follows imme- 
diately. □ 

Likewise, we have a similar result for HNN-extensions. 
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Lemma 4.7. Suppose G = A^c^c is a splitting of G, where the stable 
letter conjugates the infinite cyclic subgroups C andC' . LetrjA : A ^ A 
be a T- approximation and let C A and C' A be cyclic subgroups 
with the property that riA{C) = C and rjj^^C') = C' . Then 

G —— A^Q^f^/ 

is a T- approximation to G. 

Proof. We can characterize Hom(G, F) as 

Hom(G, r) = {(a, 7) G Hom(yl, T) x T \ a\c = L-y o a\c'}- 

where G Aut(r) is conjugation by T. Just as before, Hom(G', F) 
admits a similar characterization and the result follows. □ 

5. If there are infinitely many 

5.1. A characterization in terms of splittings of quotients. In 

this section we discuss the cases when IIIomr(-ffE; T; A) and 0{Hy., F; A) 
are infinite. The idea is to characterize the existence of infinitely many 
homomorphisms in terms of splittings of quotients of Hj^. 

Proposition 5.1. If IHomY^H-s^T; A) is infinite then there is a strict 
restricted T -limit quotient rj: Hy. L so that infinitely many elements 
of IHomT{H-£,r; A) factor through rj. The quotient L admits a free or 
essential cyclic splitting, and the coefficient subgroup is elliptic in this 
splitting. 

IfO{HY,, F; A) is infinite then there is a strict T-limit quotient rj : Hy. - 
L so that for infinitely many G (9(ifs,F; A), every representative of 
factors through rj. The quotient L is either abelian or admits a free 
or essential cyclic splitting. 

Proof. Consider the case with coefficients. Assuming IIIomr(-ffs, F; A) 
is infinite, let hn G IHomr(-ffs, F; A) be a sequence of pairwise distinct 
homomorphisms. Passing to a subsequence, we may assume that {hn) 
is a stable sequence. Let L = H^/ Kei (hn). By [281 Theorem LI 7], we 
may pass to a further subsequence and assume that every hn factors 
through the quotient map 77 : H-^ — »■ L. Since the hn are distinct, L is 
a strict restricted F-limit group. The quotient L is non-abelian and so 
by Theorem 13.91 admits a free or essential cyclic splitting in which the 
coefficient subgroup is elliptic. 

In the coefficient-free case, the fact that 0(ifs,F;A) is infinite im- 
plies that there exists a sequence of pairwise non-conjugate homomor- 
phisms hn '■ Hj] — > F. As in the previous paragraph, we can pass to a 
stable subsequence such that every hn factors through 77 : Hy L = 
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iJs/ Ker (hm)- Once again, Theorem 13.91 ensures that if L is non-abehan 
then L sphts as required. □ 

In fact, Proposition 15.11 has a strong converse. A simple version of 
this converse is encapsulated in the following two results. 

Proposition 5.2. Suppose that S and A have coefficients. Suppose 
Hy, admits a strict T-limit quotient rj : Hy, —>■ L so that 

(1) some element of IHomr{H-£,T] A) factors through rj; and 

(2) L admits a free or essential cyclic splitting in which the coeffi- 
cient subgroup is elliptic. 

Then IHomr^H^^T; A) is infinite. 

Proposition 5.3. Suppose that S and A are coefficient- free. Suppose 
admits a strict T-limit quotient rj : iJ^ L for which 

(1) a representative of some element ofO{Hj], T; A) factors through 
rj; and 

(2) L is abelian or admits a free or essential cyclic splitting. 
Then 0{Hj], F; A) is infinite. 

We will prove stronger results than these, which are more easily 
applied in the algorithmic context (Propositions [5712] and [5T3|) . How- 
ever, for the moment it is useful to think about how one might go 
about proving these results. The strategy is to pre-compose by Dehn 
twists, generalized Dehn twists or partial conjugations (see Definition 
15. lip to explicitly exhibit infinitely many elements of IHomr(ifs7 T; A) 
or 0{Hy.,T; A). If we are considering only equations, this is straight- 
forward. In general, however, we need to ensure that the inequalities 
are preserved when twisting by non-inner automorphisms of L. 

In order to do this, we use the following result. It is well known in 
the case where F is a free group, and is often called Baumslag's Lemma. 
(Note that our proof can be substantially simplified in the free case.) 

Lemma 5.4. Suppose z, ai, . . . , a„ G F and [oj, z] 1 for all i. Then 
whenever \mi\ are sufficiently large for i < n, the word 

w = aiz"^^ . . . anz"^"" 

does not commute with z. 

The proof uses the (5-hyperbolic geometry of the Cayley graph of F. 
Let (i^ be the word metric on the Cayley graph of F with respect to A 
and suppose this metric is (5-hyperbolic. To prove Lemma 15.41 we need 
a version of the Margulis Lemma for hyperbolic groups. The following 
is essentially contained in [20] . 
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Lemma 5.5. Let a^b^c,d G T and suppose that c" does not commute 
with d^. If m and n are integers, write = a[l, c™] and Jn = b[l, d"-] 
for choices of geodesic arcs in the Cayley graph ofT. Fix e > 0. Then 
the diameter of 

Im n 

(where N^{Jn) denotes the e-neighbourhood of Jn) is uniformly bounded, 
independently of m and n. 

Proof. Let Co be the number of elements in the ball of radius 85 + 4e. 
Let J < Co. 

Let /' C be the arc of points at distance at least |c| + 26 from 
the endpoints of Im- Then for x G /', (i_4((c")*x, 7^) < 25. Let n be (a 
choice of) closest-point projection to Im- Then vr o (c")* is at distance 
at most 26 from an orientation-preserving isometry c' : I' ^ Im- 

Similarly, let J' C be an arc of points at distance at least \d^\ + 
26 + 2e from the endpoints of Im, and also within e oi Jn- Then it o [d'^y 
is at distance at most 26 + 2e from an isometry d'j : J' Im- Note 
that the translation length of d'j is bounded above by a linear function 
of j. 

For a contradiction, suppose that the diameter of Im^N^{Jn) is large 
enough that there exists x E I' H J' such that c'{x) G J' and d'j{x) G /' 
for all j < Cq. In particular, d'^c'^x) = c'd'j{x) G Im] we have that 
dA{{dyc''{x),d'jC'{x)) < 45 + 2e and, likewise, dA^Cidy {x),c'd'j{x)) < 
46 + 2e. It follows that dA{{d^)~^ {c^)-\d''yc''{x),x) < 85 + 4e and so, 
by the freeness of the action on the Cayley graph 

(rf'')-^(c'^)-^(c/^)-'c" = (d^)-^' {c^)~\dy c'' 

for some distinct j,j' < Cq. Using the fact that torsion-free hyperbolic 
groups are commutative transitive, it follows that c" commutes with 
d'', as required. □ 



Proof of Lemma 5.4 We use the word-hyperbolic geometry of F. Sup- 
pose the word metric d^ on F corresponding to the generating set A is 
5-hyperbolic and denote the word length of an element 7 by |7|. 

The proof is by induction on n — note that the result is immediate 
for n = 1. If w and z commute then, by modifying m„, we can assume 
that w = 1. Fix geodesic arcs [1,2;] and [l,aj] for each i. Write Wi = 
aiz"^^ . . . z^^'^Oi so, by induction, we may assume that Wi and z do not 
commute for all i. Let 

ai = Wi_iz"''-^[l,ai] 
(where wo is taken to be 1) and 

Q = w,[l,z"''] 
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SO, if w = 1 the concatenation ai ■ Ci ' 0^2 ■■■ ctn ■ Cn defines a 2n-sided 
polygon in T. 

Any sucfi polygon is uniformly 2{n — l)5-slim, so in particular Ci lies 
within the 2(n — 1)5- neighbour hood of the union of the ctj (over all i) 
and (i (for i > 1). A segment of length at most |aj| + 4(n — 1)5 can 
lie within the neighbourhood of a j, so if A = \ai\ then the lengths 
of segments of (i covered by neighbourhoods of the other Q sum to 
at least \z'^^ \ — A — 4n{n — 1)6. It follows easily from the fact that 
rectangles are 4(5-slim that, if two geodesic segments have endpoints 
that lie within 2 (n — 1)5 of each other, then the entire segments lie 
within 2n6 of each other. Hence there exists a segment of Ci of length 
at least 

-{Iz^^'l- A-4n{n-l)S) 
n 

that lies within a 2n5- neighbourhood of some other d. Therefore by 
Lemma [575| if \mi \ is sufficiently large ai^Wi commutes with z, contra- 
dicting the inductive hypothesis. □ 

The following propositions are easy consequences. 

Proposition 5.6. Suppose that ai, . . . , a^, 61, . . . , ftfe, c are elements of 
T so that aihi ■ ■ ■ ttkhk ^ 1. Then for all hut finitely many j , the element 

{c~^aic>)hi ■ ■ ■ {c~^akc')hk 

is non-trivial in T . 

Proposition 5.7. Suppose that ai, . . . ,ak,t,c are elements ofV so that 
ait"'^ ■ ■ ■ ttkt"'' 7^ 1. Then for all but finitely many j, the element 

aiitcT-'-akitcir' 

is non-trivial in T. 

5.2. Approximate quotients. In the algorithmic setting, the prob- 
lem with applying Propositions 15.21 and 15.31 is that in general the limit 
quotient L may not be finitely presented. We deal with this by using 
F-approximations. 

Remark 5.8. Let n : Hj] L be any quotient of and letrj : L ^ L 
be a T- approximation to L. By definition rj* : Hom(L, F) — Hom(L, F) 
is a bijection, and vr* : Hom(L, F) Hom(ifs;r) is an injection. So 
the composition 

n* o {t]*)-^ : Hom(L, F) ^ Hom(i/s, T) 

is an injection. 
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In the coefficient- free case, \ 



Wx (7^(x) 




holds overT. Likewise, in the case with coefficients, \ 
then the sentence 



L={X,A\Tl) 



\/x (Jl{x,a) =^ S(a;, a)) 



holds in T. 

Therefore, in order to show that /i7omr(-f^S; T; A) and (9(iJE,r; A) 
are infinite, we will show that there are infinitely many elements of 
IHomr(L,r;A) andO{L,A,T). 

5.3. Dehn twists, generalized Dehn twists and partial conju- 
gations. In this subsection we explain why the fact that the group L 
has a splitting is enough to deduce that lHomr(I/, F; A) and 0{L, T; A) 
are infinite. 

Definition 5.9. Suppose that G is a finitely generated non-abelian 
group with a free or essential cyclic splitting O. A homomorphism 
h : G is called a witness with respect to O if 

(1) h is injective on edge groups G; 

(2) h{G) is non-abelian; 

(3) if A is a non-abelian vertex group and the edge group G is non- 
trivial then h{C) is non-central in h{A); and 

(4) if Q is a free splitting then the image of each vertex group and 
each stable letter under h is non-trivial. Furthermore, if A is a 
non-abelian vertex group, h{A) is non-abelian. 

Remark 5.10. IfG is a non-abelian strict T -limit group then a witness 
always exists. 

A witness refiects the structure of the splitting 6 well enough that 
Dehn twists, generalized Dehn twists and partial conjugation give new 
(conjugacy classes of) homomorphisms to F. 

Definition 5.11. There are sets of groups automorphisms associated 
to one-edge free or essential cyclic splittings. 

(1) If G = A* B and g E A we can define the partial conjugation 
ag G Aut(//) such that <yg{a) = a for all a E A and <yg{b) = 
ghg~^ for all b E B. 

(2) Suppose G = A *c B and G is not central in B. If G = (c) 
then we can define the Dehn twist 6c G Aut(G) by 6c{a) = a for 
a E A and 5c{b) = cbc^^ for each b E B. 
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(3) Suppose G = A*c B and B is ahelian and torsion-free. A gen- 
eralized Dehn twist is an automorphism 6' G Aut(G') that acts 
trivially on A and that acts via a unimodular linear automor- 
phism of B, fixing C . 

(4) Suppose G = A*c and let t he the stable letter. If C = (c) then 
we can define the Dehn twist 5c G Aut(G) by 5c{a) = a for 
a & A and 6c{t) = to. 

Proposition 5.12. Suppose that G is a group and that Q is a non- 
trivial (one-edge) free or essential cyclic splitting of G. Let X U A be 
a finite generating set for G, and assume that the coefficient subgroup 
(A) is elliptic in G. Suppose furthermore that A{x,a) ^ 1 is a finite 
system of inequations, and that there is a homomorphism h : G ^ T 
so that 

(i) h is a witness for O; 

(ii) the restriction of h to the coefficient subgroup {A) surjects onto 
T; and 

(iii) the inequations f^{h{x) , h(a)) ^ 1 hold in V. 
Then IHomr(G', F; A) is infinite. 

Proof. The idea is to twist h by partial conjugations, Dehn twists 
or generalized Dehn twists to construct infinitely many elements of 
Hom(G, r) and then to use Propositions 15.61 and 15.71 to conclude that 
all but finitely many of these elements satisfy the inequalities A 7^ 1. 
There are four cases to consider. 

If B is a free splitting G = A^B then we can assume that the coeffi- 
cient subgroup is contained in A. Note that there is an element g ^ A 
such that hi^g^ does not centralize h{B). The sequence of homomor- 
phisms {h o exhibits infinitely many elements of Homr(G, F) 

and, by Proposition 15.61 the inequalities A(/i o a^{x), h(a)) ^ 1 do not 
hold for at most finitely many n. Therefore IHomr(G, P; A) is infinite. 

Suppose that B is an essential cyclic splitting of the form G = A*cB 
with A and B non-abelian and the coefficient subgroup is contained in 
A. If C = (c) then h{c) does not lie in the centre of h{B) so, exactly as 
in the case of the free product, infinitely many of the homomorphisms 
{h o S^)n£N are in IHomr(G, P; A). 

Suppose now that B is an essential cyclic splitting of the form G = 
A *c B with A non-abelian and B abelian, and the coefficient group 
is contained in A. As the splitting is essential, B is of rank at least 2. 
Write B = Bq(B (t) where h{t) 7^ 1 and C C Bq. Define the generalized 
Dehn twist 6' G Aut(G) by S'{ a) = a for a G A, S'{b) = b for b G Bq 
and 6'{t) = to, where c G C \ {!}. Note that since /i is a witness. 
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h ^ h o S'. The sequence of homomorphisms {h o (5')"')neN exhibits 
infinitely many elements of Homr(G', F) and, by Proposition 15. 7^ the 
inequalities A{h o /i(a)) 7^ 1 do not hold for at most finitely 

many n. Therefore IHomr(G', F; A) is infinite. 

Suppose finally that 6 is a cyclic splitting of the form G = A*c. 
If C = (c) then the sequence of homomorphisms {h o 6^)n&N exhibits 
infinitely many elements of Homr(G', F). As before, it follows from 
Proposition 15.71 that IHomr(G, F; A) is infinite. □ 

We have a similar result for 0{G, F; A). 

Proposition 5.13. Suppose that G is a non-abelian group and that G 
is a non-trivial (one-edge) free or essential cyclic splitting of G, and G 
has at least one non-abelian vertex group. Let X be a finite generating 
set for G. Suppose furthermore that A(x) ^ 1 is a finite system of 
inequations, and that there is a homomorphism h : G T so that 

(i) h is a witness for G; and 

(ii) the inequations A{h{x)) ^ 1 hold in F. 

Then 0{G, A, F) is infinite. 

The proof is identical to the proof of Proposition 15.121 After not- 
ing that the centralizer of any non-abelian subgroup of F is trivial, it 
is straightforward to verify that the homomorphisms constructed are 
pairwise non-conjugate. 

Remark 5.14. If G is abelian and 0{G,r; A) contains a non-trivial 
conjugacy class of homomorphisms then 0{G, F; A) is infinite. Simi- 
larly, if G is a free product of abelian groups and 0{G, F; A) is non- 
empty then 0{G, F; A) is infinite. 

5.4. Checking for infinitely many solutions. We have assembled 
all the tools we need to check that IHomr(i/s, F; A) and 0{Hy,,T; A) 
are infinite. 

Definition 5.15. A presentation for a group G is said to exhibit a 
free splitting A* B if it is of the form 

{A,B\nA,ns) 

where TZjs, involves only generators in A and TZs involves only genera- 
tors m B (and A= {A\ 7^^) and B = {B \ TZb) ). 

Likewise, a presentation for a group G is said to exhibit a cyclic 
splitting A*c B if it is of the form 

{A, B, c I TZa, TZb, c = wa,c = wb) 
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where TZjs, involves only generators in A, TZb involves only generators in 
B, Wj[ is a word in the generators A and is a word in the generators 
B. (Here A= {A\ 7^^), B = {B \ TZb) and C = (c).) 

There is an obvious analogous definition of what it means for a pre- 
sentation to exhibit an HNN- extension over a cyclic subgroup. 

In what follows, any vertex group is treated as non-abelian unless its 
relations include commutators of each pair of generators. 

Definition 5.16. A presentation that exhibits a cyclic splitting is said 
to exhibit an essential cyclic splitting if whenever a vertex group is 
visibly abelian it is not virtually cyclic. 

Note that it is easy to check algorithmically if a presentation exhibits 
a free or essential cyclic splitting, and to check whether a vertex group 
is visibly abelian. Of course, one cannot in general decide if the edge 
group of a cyclic splitting is infinite, or indeed if a splitting is non- 
trivial. In our algorithms we will find witnesses that prove that our 
splittings are indeed as they appear. 

Theorem 5.17. Let T be a torsion-free hyperbolic group and S = 
1, A 7^ 1 a finite system of equations and inequations. There exists a 
Turing machine that takes as input E and A and terminates if and only 
if the set of solutions IHomr{H-£, T; A) is infinite. 

Proof. The Turing machine systematically enumerates group presenta- 
tions of the form 

L = {X,A I 7^) 

and checks to see whether L satisfies the following conditions: 

(1) the presentation exhibits a free or essential cyclic splitting G of 
L in which the coefficient subgroup is elliptic; 

(2) for each vertex group V of Q which is not visibly abelian there 
is a homomorphism /: L — s> F so that f{V) is non-abelian; 

(3) there exists a witness h for that satisfies the inequations 
A{h{x), h{a)) 7^ 1 — note that the existence of a witness can be 
checked by solving a finite system of equations and inequations 
over F; and 

(4) the sentence 

Vx (7?.(x, a) =^ a)) 

holds in F. 

If such a group L is found then IHomr(I/, F; A) is infinite, by Proposi- 
tion [5lT2l But, since 

'R-{x,a) =^ S(a;, a) 
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it follows that IHomr(i/s, T; A) is infinite by Remark 15 .81 

It remains to show that such an L always exists if IHomr(-ffs7 T; A) 
is infinite. By Proposition 15.11 Hy. has a limit group quotient L with a 
free or essential cyclic splitting in which the coefficient group is elliptic. 
By Lemmas 14.61 and 14. 7^ there exists a F- approximation 

with a splitting of the same type, in which the coefficient subgroup is 
elliptic. Since L is a limit group there exists a witness /i : L — > F, and 
the homomorphism hofj is easily seen to be a witness for the splitting 
of L. By Remark [531 if L has presentation {X, A \ TV) then the identity 

'R.{x,a) =^ a) 

holds in F. Therefore, there does exist such a group L and so a system- 
atic search will eventually find it and the proof that it has the required 
properties. □ 

Likewise, we have the following theorem. 

Theorem 5.18. Let T be a torsion-free hyperbolic group and S = 
1, A 7^ 1 a finite, coefficient-free system of equations and inequations. 
There exists a Turing machine that takes as input S and A and termi- 
nates if and only if the set of conjugacy classes of solutions 0{Hy,, F; A) 
is infinite. 

Proof. The proof is very similar to the proof of Theorem 15.171 The 
Turing machine systematically enumerates finite presentations of the 
form 

L^{X\ 7^). 

For each presentation, the Turing machine checks to see whether L 
satisfies the following conditions. 

(1) The presentation should exhibit a free or essential cyclic split- 
ting of L, or exhibit L as an abelian group. 

(a) In the split case, vertex groups which are not visibly abelian 
should be seen to be non-abelian via a homomorphism to 
F. Furthermore, there should exist a witness h for that 
satisfies the inequations A(/i(x)) 7^ 1 — again the existence 
of a witness can be checked by solving a finite system of 
equations and inequations over F. 

(b) In the abelian case, there should exist a non-trivial element 
of C(L,F;A). 
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(2) Finally, the sentence 

Vx (7^(x) =^ 

must hold in F. 

If such a group L is found then 0{Hj], F; A) is infinite, by Proposition 
15. 131 or by Remark 15.141 But, since 

it follows that 0{Hy.,T; A) is infinite. That there exists such a limit 
group quotient if 0{H-^, F; A) is infinite follows exactly as in the proof 
of Theorem I5.17[ □ 



6. If there are finitely many 

In this section we describe the other halves of the algorithms in the 
statements of Theorem Rl and Theorem [Bl We start with the case when 
IHomr(-ffs, T; A) is finite, as this is much easier. 

6.1. Finitely many solutions. 

Theorem 6.1. Let T be a torsion-free hyperbolic group. There is an 
algorithm which takes as input a finite system of equations and inequa- 
tions ( with coefficients ) over F and terminates if and only if the system 
has only finitely many solutions. 

If it terminates, it provides a list of the solutions. 

Proof. Let S = 1, A 7^ 1 be the finite system. 

According to Sela [281 Theorem 7.12] (or alternatively [H Theorem 
0.1]), we can determine if there is a solution or not. If there is not, we 
terminate with the empty list. 

If there is a solution, we search for it systematically. Since we know 
that there is a solution, we will eventually find it. The fact that there 
is a solution which does not appear on a given finite list is easily en- 
coded into a finite system of equations and inequations, and so we can 
determine if there is a new solution. 

Continuing in this manner, we will clearly discover if there are only 
finitely many solutions to S = 1, A 7^ 1, and in case we discover this 
we will find a list of all of the solutions. □ 

Combining Theorem 16.91 with Theorem 15.171 completes the proof of 
Theorem |Al 
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6.2. Finitely many conjugacy classes of solutions. We now turn 
to the question of recognizing when 0{Hy^, F; A) is finite. This is sub- 
stantially more difficult than recognizing when lHomr(ifs5 T; A) is fi- 
nite. In spirit, we want to find solutions that are shortest in their 
conjugacy classes. This is in general too much to ask, but the results 
of [9] provide us with a slightly weakened notion that is an adequate 
substitute. We refer the reader to [H Section 4] for notation and ter- 
minology. Note that we are not concerned with primary peripheral 
structures in this paper, and we can take them to be empty. 

Definition 6.2. Let H be a group with fixed generating set X. A 
homomorphism ip : H T is compatible if it is injective on the ball 
of radius 8 in H. 

Compatible homomorphisms are problematic for two reasons. First, 
a conjugacy class [(f)] G 0{H-£,T; A) may not have a compatible repre- 
sentative. Secondly, we may not be able to calculate the ball of radius 
8, as we have no solution to the word problem in H-s. We will circum- 
vent these by supplementing S and A in order to determine the ball of 
radius 8. 

Definition 6.3. Let k be a natural number, and let Bp{^x){k) be the 
ball of radius k in the free group F{X). A system of equations and 
inequations S = 1, A 7^ 1 forces the ball of radius k if there is a subset 
S C BF{x){k) such that S* C S and BF{x){k) \ 5 C A. 

There are finitely many subsets S of the ball of radius 8 in F{X). 
For such an S, let E5 = S U 5 and let A5 = A U {Bf{x){^) \ S). For 
any solution (/> to E = 1, A 7^ 1 there is a unique S C Bp(^x){^) such 
that satisfies Eg = 1 and A^ 7^ 1. Therefore we have the following 
remark. 

Remark 6.4. For S C Bf(x){^), l^t rjs : i/s H-^g be the obvious 
epimorphism. The system S5 = 1,A5 7^ 1 forces the ball of radius 8. 
Furthermore, 

Moreover, any representative 4> of a conjugacy class [(f>] G C(ifss, F; A^) 
is a compatible homomorphism H^.^ F. 

Note that 0(i?s, F; A) is finite if and only if 0{Hj:g, F; As) is finite 
for each S C Bf(x){^)- 

The property Vt defined in [9l Remark 4.8] provides an adequate 
means of recognizing short homomorphisms in conjugacy classes. The 
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property Q applies to acceptable lifts of a homomorphism. See [8] for 
the definition of an acceptable lift and also ^ for more details. 

Definition 6.5. Fix a pair of elements a, 6 G F that do not commute. 
As r is non- elementary we can always find such a pair. A homomor- 
phism ip : Hy, ^ T is fairly short if it is compatible and has an ac- 
ceptable lift ijj : Bh^{2) — s> F that satisfies Vt. The homomorphism ip is 
very short if it is compatible and every acceptable lift ip : Bhj^{2) — ^ F 
satisfies Q. 

Remark 6.6. Here are some important observations. 

(1) Note that Vt, as defined in P, Remark 4.9], depends on the choice 
of a and b. 

(2) The condition Q is a boolean combination of normalized ratio- 
nal constraints on the lift ip. 

By [9], Lemma 4.7 and Proposition 4.8], we obtain the following. 

Lemma 6.7. Any conjugacy class of compatible homomorphisms Hj] — > 
r contains at least one very short homomorphism, and at most finitely 
many fairly short homomorphisms. 

Fairly short and very short homomorphism are useful because, as 
they are characterized by a boolean combination of normalized rational 
constraints on acceptable lifts, we can follow [8] in exploiting the work 
of [To] to identify all the very short solutions to a system of equations 
and inequations. In this terminology, we can deduce the following from 
[HI Proposition L5 ]. 

Proposition 6.8. There exists an algorithm that, given a finite presen- 
tation for a torsion-free hyperbolic group T and a system of equations 
E = 1 and inequations A 7^ 1 with coefficients in T always terminates. 
If it answers "yes" then there is a fairly short solution to S = 1, A 7^ 1. 
If it answers "no" then there is no very short solution. 

This is what we need in order to test whether there are only finitely 
many conjugacy classes of solutions. 

Theorem 6.9. Let T be a torsion-free hyperbolic group. There is an 
algorithm that takes as input a finite system of equations S = 1 and 
inequations A 1 ( without coefficients ) and terminates if and only if 
there are only finitely many conjugacy classes of solutions to the system. 
In case the algorithm terminates, it provides a list consisting of exactly 
one representative of each conjugacy class of solutions. 
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Proof. In fact, we will describe an algorithm that provides a list con- 
taining at least one, and at most finitely many, representatives of each 
conjugacy class of solutions to S = 1,A 7^ 1. It is easy to pare down 
such a list so that it contains precisely one representative of each conju- 
gacy class of solutions, using a solution to the simultaneous conjugacy 
problem in F. 

For each subset S C Bf(x){8) in turn, consider the system Eg = 
1, A5 7^ 1. By Remark 16.41 0{Hy., F; A) is infinite if and only if each of 
the corresponding 0(11^,^, F; A^) are infinite. We may therefore assume 
that S = 1, A 7^ 1 forces the ball of radius 8. In particular, all solutions 
are compatible. 

Let us now describe the procedure for producing the list. Let / be 
our list of solutions, which initially is empty. Add to S = 1,A 7^ 
1 the stipulation that no solution should be equal to a solution on 
the list /, creating the new system of equations and inequations S = 
1, A' 7^ 1. Since we are only adding inequations, we have not changed 
the notions of very short and fairly short. Now apply the algorithm 
from Proposition 16.81 to the system S = 1,A' 7^ 1. If the algorithm 
from Proposition 16.81 says "no" then there is no very short solution to 
E = 1 and A' 7^ 1, and the procedure terminates with the list /. If 
the algorithm says "yes" then there is a fairly short solution. A naive 
search will eventually find such a solution. It cannot be on the list I, 
so add it to / and repeat the process. 

By Lemma 16. 7[ every conjugacy class of solutions has a very short 
representative. It follows that, if 0{HY,,r; A) is infinite then the algo- 
rithm will not terminate. On the other hand Lemma 16.71 states that 
every conjugacy class contains only finitely many fairly short represen- 
tatives, so if (9(ifs,F;A) is finite then the algorithm will eventually 
terminate and output the list /. □ 

Combining Theorem 16.91 with Theorem 15.181 completes the proof of 
Theorem [Bl 

7. Immutable subgroups 
7.L Enumerating immutable subgroups. 

Definition 7.1. Let G be a group. A finitely generated subgroup H of 
G is called immutable if there are finitely many injections 0i, . . . (pN '■ 
H ^ G so that any injection (p : H ^ G is conjugate to one of the 0j. 

We will see that all F-limit groups are either strict or immutable 
subgroups of F. Therefore, in order to understand F-limit groups, 
or even just subgroups of F, we need to study immutable subgroups. 



24 



DANIEL GROVES AND HENRY WILTON 



This is one of the big differences between F-hmit groups where F is a 
torsion-free hyperbohc group and ordinary hmit groups defined over a 
free group. Clearly, there are no non-trivial immutable subgroups of a 
free group. 

Lemma 7.2. A finitely generated subgroup of F is immutable if and 
only if it does not admit a non-trivial free splitting or an essential 
splitting over Z. 

Proof. Let if be a finitely generated subgroup of F. If if = Z then H 
is not immutable, since Z splits over 1. 

If H admits a non-trivial free or essential cyclic splitting then, tak- 
ing the inclusion /i : ii F as a witness, it follows immediately by 
Proposition 15. 131 that there are infinitely many conjugacy classes of ho- 
mo morphisms H r. As each is obtained by pre-composing h with 
an automorphism they are all injective, and so H is not immutable. 

Suppose, then, that H admits infinitely many conjugacy classes of 
embeddings into F. We can therefore choose a sequence of pairwise non- 
conjugate embeddings {0j : H — > F}. After passing to a subsequence, 
the sequence 0j can be taken to be stable. As H = H/ Ker {(pj), this 
realizes if as a strict F-limit group. It now follows from Theorem 13.91 
that H splits essentially over a cyclic subgroup. □ 



Remark 7.3. The proof of Lemma 7.2 shows that any T -limit group 
is either strict or an immutable subgroup of T, and the two cases are 
mutually exclusive. 

Example 7.4. Let F be the fundamental group of a closed hyperbolic n- 
manifold where n > 3. Then F admits no non-trivial abelian splitting 
(see, for example, [U Theorem 1.6(i)]j and so, by Lemma \T7^ is an 
immutable subgroup of itself. 

In [19] , a version of the Rips construction is given in which the kernel 
has Kazhdan's property (T), and in particular is immutable. This 
provides many further examples of finitely generated (but not finitely 
presentable) immutable subgroups. 

The following lemma provides a slightly weaker characterization of 
immutable subgroups. The advantage is that it can be recognized al- 
gorithmically. 

Lemma 7.5. A finitely generated subgroup HofTis immutable if and 
only if there are finitely many homomorphisms pi, . . . , : if — >■ F and 
an integer D > 1, so that for any homomorphism p : H ^ T, either 

(1) p is conjugate to one of the pi,- or 

(2) p is not injective on the ball of radius D about 1 in H . 
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Proof. If H is not immutable then it admits infinitely many conjugacy 
classes of embeddings, and so clearly does not satisfy the dichotomy in 
the statement of the lemma. 

On the other hand, suppose that H does not satisfy the statement 
of the lemma. Then there is a sequence {0j : if — > F} of non-conjugate 
homomorphisms so that (pi is injective on the ball of radius i about 1 
in H. We may now pass to a stable subsequence with trivial stable 
kernel and deduce that H is a. strict F-limit group and therefore not 
immutable. □ 

Note that we do not insist that the homomorphisms pi are injective. 
However, since H is assumed to be a subgroup of F, necessarily at least 
one of the pi is an embedding. 

Example 7.6. Fix a generating set X for H an immutable subgroup of 
F (e.g. Example 7.4\ ). The property that a map from X into F extends 



to a homomorphism h : H T that is injective on the ball of radius D 
in the Cayley graph of H with respect to X is easily encoded as a system 
of (possibly infinitely many) equations and finitely many inequations 
over F. By Lemma pOl there are only finitely many conjugacy classes 



of solutions. By Theorem \4-4\ '^^ have an example of a finite system 
of equations and inequations with only finitely many conjugacy classes 
of solutions in F. 



Note that if H happens to be finitely presentable (as in Example 7.4\ ), 



it is not necessary to appeal to Theorem 4-4 



One of the problems with finitely generated subgroups of torsion-free 
hyperbolic groups is that they need not be finitely presentable. There 
are also torsion-free hyperbolic groups for which it is undecidable which 
finite subsets generate finitely presentable subgroups (see [H Theorem 
1]). We do not know the answer to the following question. 

Question 7.7. Let T be a torsion-free hyperbolic group. Is there an 
algorithm that takes as input finite subsets A of T so that {A) is finitely 
presented and finds a finite presentation for (A) ? 

We now have the tools to prove that we can recognize algorithmically 
when a finite set generates an immutable subgroup (although not when 
it does not!). Theorem [Cl is an immediate corollary. 

Proposition 7.8. There exists a Turing machine that takes as input a 
finite subset ^ C F and terminates if and only if the subgroup H = (A) 
is immutable. 

Proof. Our approach is to construct a sequence of epimorphisms Hd 
H (for any D G N) and to test the criterion of Lemma [731 on each H^. 



26 



DANIEL GROVES AND HENRY WILTON 



Let Hd be the group generated by S with relations equal to all 
the loops in the ball of radius D in H . So there is an epimorphism 
ri£) : Hd H that is an isometry between the balls of radius D. 
Homomorphisms Hn — > F that are injective on the ball of radius D 
in Hd can be characterized precisely by a system of equations and 
inequations over F — the equations are the relations of Ho and the 
inequations separate the points in the ball of radius D. (Although 
we do not have a solution to the word problem in H^,, we can still 
construct its ball of radius D since it is, by definition, isometric to the 
ball of radius D in H.) Using the algorithm of Theorem [B] we can 
now determine whether this system of equations and inequations has 
finitely many conjugacy classes of solutions. If it does then it follows 
immediately that H is immutable. 

Checking this for each D in turn, we have a process that, if it 
terminates, confirms that H is immutable. It remains to show that 
the process terminates whenever H is immutable. By Theorem 14. 5[ 
Hom(ffc F) = Hom(iJ, F) for all sufficiently large D — that is, in our 
terminology, Hd is a F-approximation for H. For large enough D we 
will also have that D satisfies the conclusions of Lemma 17.51 For such 
a D, there are only finitely many conjugacy classes of homomorphisms 
Hd — > F that are injective on the ball of radius D. Therefore, if H is 
immutable then the process will terminate. □ 

7.2. Questions. We have proved that the set of immutable subgroups 
of F is recursively enumerable. 

Question 7.9. Is the set of immutable subgroups ofT recursive? 

Here a class of groups is recursive if there is an algorithm that enu- 
merates the class of groups so that the list contains a single represen- 
tative of each isomorphism class. This is essentially the same as asking 
whether the isomorphism problem is solvable for immutable subgroups. 
One would expect the answer to be negative, as the isomorphism prob- 
lem for finitely generated subgroups of hyperbolic groups is unsolvable. 

Applying the construction of [12] to a group with unsolvable word 
problem, we obtain the following. 

Proposition 7.10. There are torsion-free hyperbolic groups F for which 
the membership problem for finitely generated immutable subgroups is 
unsolvable. 

However, no immutable subgroup constructed in this way can be 
finitely presentable. 
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Question 7.11. Is the membership problem for finitely presentable im- 
mutable subgroups solvable? 

Question 17.111 appears to be related to the isomorpliism problem for 
finitely presented subgroups of torsion-free hyperbolic groups. 

Question 7.12. Let T be a (torsion-free) hyperbolic group. Is there an 
algorithm that takes as input a finite subset of T and decides whether 
or not the subgroup generated is immutable? 

Decision problems about finitely generated subgroups of hyperbolic 
groups are rarely solvable (see, for instance, [23], [7|). Nevertheless, the 
results of this paper reduce Question l7.12l to determining if a subgroup 
of r splits freely or essentially over Z. 
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